PATENT 
HPDNO: 10012199-1 



SERVER SYSTEM WITH SEGREGATED MANAGEMENT LAN 
AND PAYLOAD LAN 

The Field of the Invention 

The present invention relates to server systems. More particularly, the invention 
relates to a compact peripheral component interconnect (cPCI) server system with a 
segregated management local area network (LAN) and payload LAN, which is used for 
server data traffic typically exposed or sent to a less secure environment, such as the 
Internet. 

Background of the Invention 

Console communications are used in server systems to send and receive status, 
control and configuration information. Console communications are typically transmitted 
and received via a single LAN interface (i.e., a LAN that combines console and payload 
communications), or via a cable to an RS-232 port on a server. 

When there is no console LAN, each server typically includes an RS-232 port for 
console communications. When a large number of servers are to be controlled, a 
complex, hard-to-manage wiring bundle to each individual server's RS-232 port must be 
implemented. Using an RS-232 port for console communications is sufficient for a 
standalone server, but when the server is integrated with many others in a common 
chassis, a separate cable for each server is difficult to maintain and configure. If any 
consolidation is to be done, it is typically implemented by a separate device outside of the 
chassis. Consequently, most customers route all of the cables a short distance to a special 
switch, such as those made by Raritan and Lantronics. Though this simplifies the cable 
bundle by giving a single port of access to the congregation of servers, it adds cost to the 
system in terms of money and space. 

If a single LAN interface is used, there is a security hole in that LAN console 
control information commingles with payload information on a single customer payload 
LAN. This commingling of signals on a single LAN allows for unauthorized snooping. 
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and the potential for unauthorized communications to the console devices. For a single 
LAN interface, a security driven software layer can used (at additional cost), but there is a 
possibility that the security layer could be compromised. 

It would be desirable for a server system to provide a more convenient and secure 
5 console communication system. 

Summary of the Invention 

One form of the present invention provides a server system including a plurality 
of host processor cards for providing management LAN commimications and payload 

10 LAN communications. A first card is coupled to the plurality of host processor cards and 
is coupled to a payload LAN. The plurality of host processor cards are configured to 
provide payload LAN communications with the management LAN through the first card. 
A second card is coupled to the plurality of host processor cards and coupled to a 
management LAN. The plurality of host processor cards are configured to provide 

15 management LAN communications with the management LAN through the second card. 

Brief Description of the Drawin2S 

Figure 1 is a front perspective view illustrating a server system according to one 
embodiment of the present invention. 
20 Figure 2 is a rear perspective view illustrating the server system shown in Figure 

1. 

Figure 3 is a block diagram illustrating major components of a server system 
according to one embodiment of the present invention. 

Figure 4 is a front view of one of LCD panels used by a server system according 
25 to one embodiment of the present invention. 

Figure 5 is an electrical block diagram illustrating major components of a server 
management card (SMC) according to one embodiment of the present invention. 

Fi gure 6 is an electrical block diagram illustrating a network, including server 
systems according to one embodiment of the present invention. 
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Description of the Preferred Embodiments 

In the following detailed description of the preferred embodiments, reference is 
made to the accompanying drawings that form a part hereof, and in which is shown by 
5 way of illustration specific embodiments in which the invention may be practiced. It is to 
be xmderstood that other embodiments may be utilized and structural or logical changes 
may be made without departing from the scope of the present invention. The following 
detailed description, therefore, is not to be taken in a limiting sense, and the scope of the 
present invention is defined by the appended claims. 

10 

I. SERVER SYSTEM 

Figure 1 is a front perspective view illustrating a server system 100 according to 
one embodiment of the present invention. Figure 2 is a rear perspective view illustrating 
server system 100. Server system 100 includes panels 102, liquid crystal display (LCD) 

15 panels 104A and 104B (collectively referred to as LCD panels 104), backplane 106, 

chassis 108, and dual redundant power supply units 114A and 1 14B (collectively referred 
to as power supply units 1 14). Panels 102 are attached to chassis 108, and provide 
protection for the internal components of server system 100. Backplane 106 is positioned 
near the center of server system 100. Backplane 106 is also referred to as midplane 106. 

20 LCD panels 1 04A and 1 04B are substantially identical, except for their placement on 
server system 100. LCD panel 104A is positioned on a front side of server system 100, 
and LCD panel 104B is positioned on a back side of server system 100. 

Power supply units 1 14 are positioned at the bottom of server system 100 and 
extend from a back side of server system 100 to a fi-ont side of server system 100. Power 

25 supply units 1 14 each include an associated cooling fan 304 (shown in block form in 

Figure 3). In one form of the invention, additional cooling fans 304 are positioned behind 
LCD panel 104B. In one embodiment, 4 chassis cooling fans 304 are used in server 
system 100. In an alternative embodiment, 6 chassis cooling fans 304 are used. Other 
numbers and placement of cooling fans 304 may be used. In one form of the invention, 
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cooling fans 304 form an N+1 redundant cooling system, where "N" represents the total 
number of necessary fans 304, and "1" represents the number of redundant fans 304. 

In one embodiment, server system 100 supports the Compact Peripheral 
Component Interconnect (cPCI) form factor of printed circuit assemblies (PCAs). Server 
5 system 100 includes a plurality of cPCI slots 1 10 for receiving cards/modules 300 (shown 
in block form in Figure 3). In one embodiment, system 100 includes ten slots 1 10 on 
each side of backplane 106 (referred to as the 10 slot configuration). In an alternative 
embodiment, system 100 includes nineteen slots 1 10 on each side of backplane 106 
(referred to as the 19 slot configuration). Additional alternative embodiments use other 

10 slot configurations. 

Figure 3 is a block diagram illustrating major components of server system 100. 
Server system 100 includes backplane 106, a plurality of cards/modules 300A-300G 
(collectively referred to as cards 300), fans 304, electrically erasable programmable read 
only memory (EEPROM) 314, LEDs 322, LCD panels 104, power supply units (PSUs) 

15 114, and temperature sensor 324. Cards 300 are inserted in slots 110 (shown in Figures 1 
and 2) in system 100. In one form of the invention, cards 300 may occupy more than one 
slot 1 10. In one embodiment, cards 300 include host processor cards 300A, hard disk 
cards 300B, managed Ethernet switch cards 300C and 300D, a server management card 
(SMC) 300E, and 2 redundant SMC local area network (LAN) rear transition modules 

20 (RTMs) 3 OOF and 300G. In one embodiment, there is one managed Ethernet switch card 
300C fitted in the 10 slot chassis embodiment, and up to two managed Ethernet switch 
cards 300C and 300D fitted in the 19 slot chassis embodiment. In one form of the 
invention, managed Ethernet switch cards 300C and 300D are "Procurve" managed 
Ethernet switch cards. 

25 In one embodiment, two types of host processor cards 3 00 A may be used in server 

system 100 - PA-RISC host processor cards and IA32 host processor cards. Multiple 
host processor cards 300A and hard disk cards 300B are used in embodiments of server 
system 100, but are each represented by a single card in Figure 3 to simply the figure. In 
one form of the invention, up to 8 host processor cards 300A are used in the 10 slot 
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configuration, and up to 16 host processor cards 300A are used in the 19 slot 
configuration In one embodiment, each of cards 300 can be hot swapped. 

hi one embodiment, cards 300 each include a pair of EEPROMs 302A and 302B, 
which are discussed below. Power supply units 1 14 each include an EEPROM 323 for 
5 storing power supply identification and status information. Fans 304 include associated 
sensors 306 for monitoring the speed of the fans 304. In one embodiment, LEDs 322 
include eight status LEDs, six LAN LEDs to indicate the speed and link status of LAN 
links 318, a blue hot swap status LED to indicate the ability to hot swap SMC 300E, a 
power-on indicator LED, and three fan control indicator LEDs. 

10 The operational health of cards 300 and system 100 are monitored by SMC 300E 

to ensure the reliable operation of the system 100. SMC 300E includes serial ports 310 
(discussed below), and an extraction lever 308 with an associated switch. In one 
embodiment, all cards 300 include an extraction lever 308 with an associated switch. 

In one embodiment, SMC 300E is the size of a typical compact PCI (cPCI) card, 

15 and supports PA-RISC and the IA32 host processor cards 300A. SMC 300E electrically 
connects to other components in system 100, including cards 300, temperature sensor 
324, power supply units 1 14, fans 304, EEPROM 3 14, LCD panels 104, LEDs 322, and 
SMC rear transition modules 300F and 300G via backplane 106. In most cases, the 
connections are via I^C buses 554 (shown in Figure 5), as described in further detail 

20 below. The I^C buses 554 allow bi-directional commxmication so that status information 
can be sent to SMC 300E and configuration information sent from SMC 300E. La one 
embodiment, SMC 300E uses fc buses 554 to obtain environmental information from 
power supply units 114, host processor cards 3 00 A, and other cards 300 fitted into system 
100. 

25 SMC 300E also includes a LAN switch 532 (shown in Figure 5) to connect 

console management LAN signals from the host processor cards 300A to an external 
management network (also referred to as management LAN) 320 via one of the two SMC 
rear transition modules 300F and 300G. hi one embodiment, the two SMC rear transition 
modules 3 OOF and 300G each provide external 10/ 100Base-T LAN links 318 for 
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connectivity to management LAN 320. In one embodiment, SMC rear transition modules 
3 OOF and 300G are fibre-chaimel, port-bypass cards 

Managed Ethernet switch cards 300C and 300D are connected to host processor 
cards 300A through backplane 106, and include external 10/100/lOOOBase-T LAN links 
5 301 for connecting host processor cards to external customer or payload LANs 303. 
Managed Ethernet switch cards 300C and 300D are fully managed LAN switches. 

IL LCD PANEL 

Figure 4 is a front view of one of LCD panels 104. In one form of the invention, 
10 each LCD panel 104 includes a 2 x 20 LCD display 400, 1 0 alphanumeric keys 402, 5 
menu navigation/activation keys 404A-404E (collectively referred to as navigation keys 
404), and a lockout key 406 with associated LED (not shown) that lights lockout key 406. 
If a user presses a key 402, 404, or 406, an alert signal is generated and SMC 300E polls 
the LCD panels 104A and 104B to determine which LCD panel was used, and the key 
1 5 that was pressed. 

Alphanumeric keys 402 allow a user to enter alphanumeric strings that are sent to 
SMC 300E. Navigation keys 404 allow a user to navigate through menus displayed on 
LCD display 400, and select desired menu items. Navigation keys 404A and 404B are 
used to move left and right, respectively, within the alphanumeric strings. Navigation key 
20 404C is an "OK/Enter" key. Navigation key 404D is used to move down. Navigation 
key 404E is a "Cancel" key. 

LCD panels 104 provide access to a test shell (discussed below) that provides 
system information and allows configuration of system 100. As discussed below, other 
methods of access to the test shell are also provided by system 100. To avoid contention 
25 problems between the two LCD panels 1 04, and the other methods of access to the test 
shell, a lockout key 406 is provided on LCD panels 104. A user can press lockout key 
406 to gain or release control of the test shell. In one embodiment, lockout key 406 
includes an associated LED to light lockout key 406 and indicate a current lockout status. 
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In one embodiment, LCD panels 1 04 also provide additional information to that 
displayed by LEDs 322 during start-up. If errors are encoimtered during the start-up 
sequence, LCD panels 1 04 provide more information about the error without the operator 
having to attach a terminal to one of the SMC serial ports 310. 

5 

III. SERVER MANAGEMENT CARD (SMC) 
A. SMC Overview 

Figure 5 is an electrical block diagram illustrating major components of server 
10 management card (SMC) 300E. SMC 300E includes flash memory 500, processor 502, 
dynamic random access memory (DRAM) 504, PCI bridge 506, field programmable gate 
array (FPGA) 508, output registers 510A and 510B, input registers 512A and 512B, fan 
controllers 526A-526C (collectively referred to as fan controllers 526), network controller 
530, LAN switch 532, universal asynchronous receiver transmitter (UART) with modem 
15 534, dual UART 536, UART with modem 53 8, clock generator/watchdog 540, battery 
542, real time clock (RTC) 544, non- volatile random access memory (NVRAM) 546, I^C 
controllers 548A-548H (collectively referred to as f C controllers 548), EEPROM 550, 
and temperature sensor 324. In one embodiment, components of SMC 300E are 
connected together via PCI buses 507. In one form of the invention, PCI buses 507 are 
20 not routed between slots 1 1 0. Switched LAN signals through LAN switch 532 are routed 
between slots 110. 

Functions of SMC 3 DOE include supervising the operation of other components 
within system 100 (e.g. fan speed, temperature, card present) and reporting their health to 
a central location (e.g., external management network 320), reporting any failures to a 
25 central location (e.g., external management network 320), providing a LAN switch 532 to 
connect console management LAN signals from the SMC 300E and host processor cards 
300A to an external management network 320, and providing an initial boot 
configuration for the system 100. 
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B. SMC Processor And Memory 

SMC 300E includes chassis management processor 502. In one embodiment, 
chassis management processor 502, also referred to as SMC processor 502, is a 
StrongARM SA-110 processor with supporting buffer, hi one embodiment, SMC 300E 
5 uses a Linux operating system. SMC 300E also runs server management application 

(SMA) software/firmware. In one embodiment, the operating system and SMA are stored 
in flash memory 500. In one form of the invention, all information needed to power-up 
SMC 300E, and for SMC 300E to become operational, are stored in flash memory 500. 
In one embodiment, flash memory 500 includes 4 to 16 Mbytes of storage space to allow 

10 SMC 300E to boot-up as a stand-alone card (i.e., no network connection needed). 

SMC 300E also mcludes DRAM 504. hi one embodiment, DRAM 504 includes 
32, 64 or 128 Mbytes of storage space. In one form of the invention, a hardware fitted 
table is stored in DRAM 504. The hardware fitted table includes information 
representing the physical configuration of system 100. The hardware fitted table changes 

15 if there is a physical change to system 100, such as by a hardware device being added to 
or removed from system 100. The hardware fitted table includes hardware type 
information (e.g., whether a device is an IA32 / PA-RISC / Disk Carrier / RTM (i.e., rear 
transition module) / PSU / LCD panel / Modem / Unknown device, etc.), hardware 
revision and serial number, status information, configuration information, and hot-swap 

20 status information. 

Processor 502 is coupled to FPGA 508. FPGA 508 includes 6 sets of input/output 
lines 522A-522F. Lines 522 A are connected to jumpers for configuring SMC 300E. 
Lines 522B are hot swap lines for monitoring the hot swap status of cards 300. In one 
embodiment, hot swap lines 522B include 1 8 hot swap status input hues, which allow 

25 SMC 300E to determine the hot swap status of the host processor cards 300A, hard disk 
cards 300B, managed Ethernet switch cards 300C and 300D, SMC rear transition 
modules 3 OOF and 300G, and power supply units 1 14. Lines 522C are LED lines that are 
coupled to LEDs 322. Lines 522D are fan input lines that are coupled to fan sensors 306 
for monitoring the speed of fans 304. Luies 522E are power supply status lines that are 
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coupled to power supply units 1 14 for determining whether both, or only one power 
supply unit 1 14 is present. Lines 522F are SMB alert lines for communicating alert 
signals related to SMB fc buses 554B, 554D, and 554F. 

5 C. Clock. Battery & NVRAM 

SMC 3 DOE includes a real time clock (RTC) 544 and an associated battery 542 to 
preserve the clock. Real time clock 544 provides the correct time of day. SMC 300E 
also includes NVRAM 546 for storing clock information. In one embodiment, NVRAM 
546 uses the same battery as real time clock 544. 

10 

D. LAN switch 

SMC 300E sends and receives management LAN communications through PCI 
bridge 506 and controller 530 to LAN switch 532. In one embodiment, LAN switch 532 
is an unmanaged LAN switch including 19 ports, with two ports connected to SMC rear 

15 transition modules 300F and 300G (shown in Figure 3) via links 53 1 A for 

communications with external management network 320 (shown in Figure 3), 16 ports 
for connecting to the management LAN connections of up to 16 host processor cards 
300A via links 53 IB through backplane 106, and one port for connecting to the SMC's 
LAN port (i.e., output of controller 530) via links 53 IC. SMC 300E provides 

20 management support for console LAN management signals sent and received through 
LAN switch 532. SMC 300B provides control of management LAN signals of host 
processor cards 3 OCA, managed Ethernet switches 300C and 3 GOD, SMC processor 502, 
and SMC rear transition modules 300F and 300G. SMC 300E monitors the status of the 
management LAN connections of up to 16 host processor cards 300A to LAN switch 532, 

25 and reports an alarm event if any of the connections are lost. FPGA 508 and LAN switch 
532 are coupled together via an RS-232 link 533 for the exchange of control and status 
information. 

E. I^C Buses 
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Server system 100 includes eight I^C buses 554A-554H (collectively referred to as 
I^C buses 554) to allow communication with components within system 100. I^C buses 
554 are coupled to FPGA 508 via I^C controllers 548. In one embodiment, the I^C buses 
554 include 3 intelligent platform management bus (IPMB) buses 554A, 554C, and 554E, 
5 3 system management bus (SMB) buses 554B, 554D, and 554F, a backplane ID bus (BP) 
554G, and an fc bus 554H for accessing SMC EEPROM 550 and chassis temperature 
sensor 324. A different number and configuration of I^C buses 554 may be used 
depending upon the desired implementation. SMC 3G0E maintains a system event log 
(SEL) within non- volatile flash memory 500 for storing information gathered over I^C 
10 buses 554. 

The IPMB I^C buses 554A, 554C, and 554E implement the intelligent platform 
management interface (IPMI) specification. The IPMI specification is a standard defining 
an abstracted interface to platform management hardware. IPMI is layered over the 
standard I^C protocol. SMC 300E uses one or more of the IPMB fc buses 554A, 554C, 

15 and 554E to retrieve static data from each of the host processor cards 3 OCA and hard disk 
cards 300B. The static data includes identification information for identifying each of the 
cards 300A and 300B. Each slot 1 10 in system 100 can be individually addressed to 
retrieve the static configuration data for the card 300 in that slot 110. In one embodiment, 
the host processor cards 300A and hard disk cards 300B each include an EEPROM 3 02 A 

20 (shown in Figure 3) that stores the static identification information retrieved over IPMB 
l^C buses 554A, 554C, and 554E. In one embodiment, each EEPROM 302A contains the 
type of card, the name of the card, the hardware revision of the card, the card's serial 
number and card manufacturing information. 

SMC 300E also uses one or more of the IPMB fC buses 554A, 554C, and 554E, 

25 to retrieve dynamic environmental information from each of the host processor cards 

300A and hard disk cards 300B. In one embodiment, this dynamic information is held in 
a second EEPROM 302B (shown in Figure 3) on each of the cards 300A and 300B. In 
one form of the invention, the dynamic board data includes card temperature and voltage 
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measurements. In one embodiment, SMC 300E can write information to the EEPROMs 
302A and 302B on cards 300. 

The three SMB fc buses 554B, 554D, and 554F also implement the IPMI 
specification. The three SMB fc buses 554B, 554D, and 554F, are coupled to LEDs 
5 322, the two LCD panels 104, the dual redundant power supply units 114, and some of 
the host processor cards 300A. SMC 300E uses one or more of the SMB fc buses 554B, 
554D, and 554F, to provide console communications via the LCD panels 104. In order 
for the keypad key-presses on the LCD panels 104 to be communicated back to SMC 
3 DOE, an alert signal is provided when keys are pressed that causes SMC 300E to query 

1 0 LCD panels 1 04 for the keys that were pressed. 

SMC 300E communicates with power supply units 1 14 via one or more of the 
SMB I^C buses 554B, 554D, and 554F to obtain configuration and status information 
including the operational state of the power supply units 114. In one embodiment, the 
dual redundant power supply units 1 14 provide voltage rail measurements to SMC 300E. 

15 A minimum and maximum voltage value is stored by the power supply units 114 for each 
measured rail. The voltage values are polled by SMC 300E at a time interval defined by 
the current configuration information for SMC 300E. If a voltage measurement goes out 
of specification, defined by maximum and minimum voltage configuration parameters, 
SMC 300E generates an alarm event. In one embodiment, power supply units 114 store 

20 configuration and status information in their associated EEPROMs 323 (shown in Figure 
3). 

Backplane ID Bus (BP) 554G is coupled to backplane EEPROM 314 (shown in 
Figure 3) on backplane 106. SMC 300E communicates with the backplane EEPROM 
314 over the BP bus 554G to obtain backplane manufacturing data, including hardware 
25 identification and revision number. On start-up, SMC 300E communicates with 

EEPROM 3 14 to obtain the manufacturing data, which is then added to the hardware 
fitted table. The manufacturing data allows SMC 300E to determine if it is in the correct 
chassis for the configuration it has on board, since it is possible that the SMC 300E has 
been taken fi-om a different chassis and either hot-swapped into a new chassis, or added to 



11 



PATENT 
HPDNO: 10012199-1 



a new chassis and the chassis is then powered up. If there is no valid configuration on 
board, or SMC 300E cannot determine which chassis it is in, then SMC 300E waits for a 
pushed configuration from external management network 320, or for a manual user 
configuration via one of the connection methods discussed below. 

hi one embodiment, there is a single temperature sensor 324 within system 100. 
SMC 300E receives temperature information from temperature sensor 324 over I^C bus 
554H. SMC 3 ODE monitors and records this temperature and adjusts the speed of the 
cooling fans 304 accordingly, as described below. SMC also uses I^C bus 554H to access 
EEPROM 550, which stores board revision and manufacture data for SMC 300E. 

F. Serial Ports 

SMC 300E includes 4 RS-232 interfaces 310A-310D (collectively referred to as 
serial ports 310). RS-232 serial interface 3 1 OA is via a 9-pin Male D-type connector on 
the front panel of SMC 300E. The other three serial ports 3 lOB-3 lOD are routed through 
backplane 106. The front panel RS-232 serial interface 31 OA is connected via a UART 
with a full modem 534 to FPGA 508, to allow monitor and debug information to be made 
available via the front panel of SMC 300E. Backplane serial port 310D is also connected 
via a UART with a full modem 538 to FPGA 508. hi one embodiment, backplane serial 
port 310D is intended as a debug or console port. The other two backplane serial 
interfaces 31 OB and 3 IOC are connected via a dual UART 536 to FPGA 508, and are 
routed to managed Ethernet switches 300C and 300D through backplane 106. These two 
backplane serial interfaces 31 OB and 3 IOC are used to connect to and configure the 
managed Ethernet switch cards 300C and 300D, and to obtain status information from the 
managed Ethernet switch cards 300C and 3 GOD. 

G. Fans And Temperature Control 

Li one embodiment, server system 100 includes six chassis fans 304. Server 
system 100 includes temperature sensor 324 to monitor the chassis temperature, and fan 
sensors 306 to monitor the six fans 304. hi one embodiment, fan sensors 306 indicate 
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whether a fan 304 is rotating and the fan's speed setting. In one form of the invention, 
FPGA 508 includes 6 fan input hnes 522D (i.e., one fan input line 522D from each fan 
sensor 306) to monitor the rotation of the six fans 304, and a single fan output line 524 
coupled to fan controllers 526A-526C. Fan controllers 526A-526C control the speed of 
5 fans 304 by a PWM (pulse width modulation) signal via output lines 528A-528F. If a fan 
304 stalls, the monitor line 522D of that fan 304 indicates this condition to FPGA 508, 
and an alarm event is generated. The speed of fans 304 is varied to maintain an optimum 
operating temperature versus fan noise within system 100. If the chassis temperature 
sensed by temperature sensor 324 reaches or exceeds a temperature alarm threshold, an 

10 alarm event is generated. When the temperature reduces below the alarm threshold, the 
alarm event is cleared. If the temperature reaches or exceeds a temperature critical 
threshold, the physical integrity of the components within system 100 are considered to 
be at risk, and SMC 300E performs a system shut-down, and all cards 300 are powered 
down except SMC 300E. When the chassis temperature falls below the critical threshold 

15 and has reached the alarm threshold, SMC 300E restores the power to all of the cards 300 
that were powered down when the critical threshold was reached. 

hi one embodiment, SMC 300E controls the power state of cards 300 using power 
reset (PRST) lines 514 and power off (PWR OFF) lines 516. FPGA 508 is coupled to 
power reset lines 514 and power off lines 516 via output registers 51 OA and 510B, 

20 respectively. In one embodiment, power reset lines 5 1 4 and power off lines 5 1 6 each 
include 19 output lines that are coupled to cards 300. SMC 300E uses power off lines 
516 to turn off the power to selected cards 300, and uses power reset lines 514 to reset 
selected cards 300. In one embodiment, a lesser number of power reset and power off 
lines are used for the 10 slot chassis configuration. 

25 

H. Clock Generator / Watchdog 

SMC 300E is protected by both software and hardware watchdog timers. The 
watchdog timers are part of clock generator/watchdog block 540, which also provides a 
clock signal for SMC 300E. The hardware watchdog timer is started before software 
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loading commences to protect against failure. In one embodiment, the time interval is set 
long enough to allow a worst-case load to complete. If the hardware watchdog timer 
expires, SMC processor 502 is reset. 

5 I. Modes Of Operation 

hi one embodiment, SMC 300E has three phases or modes of operation ~ Start- 
up, normal operation, and hot swap. The start-up mode is entered on power-up or reset, 
and controls the sequence needed to make SMC 300E operational. SMC 300E also 
provides minimal configuration information to allow chassis components to communicate 
10 on the management LAN. The progress of the start-up procedure can be followed on 
LEDs 322, which also indicate any errors during start-up. 

The normal operation mode is entered after the start-up mode has completed. la 
the normal operation mode, SMC 300E monitors the health of system 100 and its 
components, and reports alarm events. SMC 300E monitors the chassis environment, 
15 including temperature, fans, input signals, and the operational state of the host processor 
cards 300A. 

SMC 300E reports alarm events to a central point, namely an alarm event 
manager, via the management LAN (i.e., through LAN switch 532 and one of the two 
SMC rear transition modules 300F or 300G to external management network 320). The 

20 alarm event manager is an external module that is part of external management network 
320, and that handles the alarm events generated by server system 100. The alarm event 
manager decides what to do with received alarms and events, and initiates any recovery or 
reconfiguration that may be needed. In addition to sending the alarm events across the 
management network, a system event log (SEL) is maintained in SMC 300E to keep a 

25 record of the alarms and events. The SEL is held in non-volatile flash memory 500 in 
SMC 300E and is maintained over power cycles, and resets of SMC 300E. 

In the normal operation mode, SMC 300E may receive and initiate configuration 
commands and take action on received commands. The configuration commands allow 
the firmware of SMC processor 502 and the hardware controlled by processor 502 to be 
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configured. This allows the operation of SMC 300E to be customized to the current 
environment. Configuration commands may originate firom the management network 
320, one of the local serial ports 3 10 via a test shell (discussed below), or one of the LCD 
panels 104. 

5 The hot swap mode is entered when there is an attempt to remove a card 300 fi-om 

system 100. In one embodiment, all of the chassis cards 300 can be hot swapped, 
including SMC 300E, and the two power supply units 114. An application shutdown 
sequence is initiated if a card 300 is to be removed. The shutdown sequence performs all 
of the steps needed to ready the card 300 for removal. 

10 hi one embodiment, FPGA 508 includes 18 hot swap status inputs 522B. These 

inputs 522B allow SMC 300E to determine the hot swap status of host processor cards 
300A, hard disk cards 300B, managed Ethernet switch cards 300C and 300D, SMC rear 
transition module cards 300F and 300G, and power supply units 1 14. The hot-swap 
status of the SMC card 300E itself is also determined through this interface 522B. 

1 5 An interrupt is generated and passed to SMC processor 502 if any of the cards 300 

in system 100 are being removed or installed. SMC 300E monitors board select 
(BD SEL) lines 518 and board healthy (HEALTHY) lines 520 of cards 300 in system 
100. hi one embodiment, board select fines 518 and healthy lines 520 each include 19 
input lines, which are connected to FPGA 508 via input registers 512A and 512B, 

20 respectively. SMC 300E monitors the board select luies 5 1 8 to sense when a card 300 is 
installed. SMC 300E monitors the healthy lines 520 to determine whether cards 300 are 
healthy and capable of being brought out of a reset state. 

When SMC 300E detects that a card has been inserted or removed, an alarm event 
is generated. When a new card 300 is inserted in system 100, SMC 300E determines the 

25 type of card 300 that was inserted by polling the identification EEPROM 302A of the 
card 300. Information is retrieved from the EEPROM 302A and added to the hardware 
fitted table. SMC 300E also configures the new card 300 if it has not been configured, or 
if its configuration differs from the expected configuration. When a card 300, other than 
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the SMC 300E, is hot-swapped out of system 100, SMC 300E updates the hardware fitted 
table accordingly. 

In one embodiment, SMC 300E is extracted in three stages: (1) an interrupt is 
generated and passed to the SMC processor 502 when the extraction lever 308 on the 
SMC front panel is set to the "extraction" position in accordance with the Compact PCI 
specification, indicating that SMC 300E is about to be removed; (2) SMC processor 502 
warns the external management network 320 of the SMC 300E removal and makes the 
extraction safe; and (3) SMC processor 502 indicates that SMC may be removed via the 
blue hot swap LED 322. SMC 300E ensures that any application download and flashing 
operations are complete before the hot swap LED 322 indicates that the card 300E may 
be removed. 

J. User Connectivity 

ha one embodiment, there are two test shells implemented within SMC 300E. 
There is an application level test shell that is a normal, run-time, test shell accessed and 
used by users and applications. There is also a stand-alone test shell that is a 
manufacturer test shell residing in flash memory 500 that provides manufacturing level 
diagnostics and functions. The stand-alone test shell is activated when SMC 300E boots 
and an appropriate jumper is m place on SMC 300E. The stand-alone test shell allows 
access to commands that the user would not, or should not have access to. 

The test shells provide an operator interface to SMC 300E. This allows an 
operator to query the status of system 100 and (with the required authority level) to 
change the configuration of system 100. 

A user can interact with the test shells by a number of different methods, 
including locally via a terminal directly attached to one of the serial ports 310, locally via 
a terminal attached by a modem to one of the serial ports 310, locally via one of the two 
LCD panels 104, and remotely via a telnet session established through the management 
LAN 320. A user may connect to the test shells by connecting a terminal to either the 
front panel serial port 3 lOA or rear panel serial ports 3 lOB-3 lOD of SMC 300E, 
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depending on the console/modem serial port configuration. The RS-232 and LAN 
connections provide a telnet console interface. LCD panels 104 provide the same 
command features as the telnet console interface. SMC 300E can function as either a 
dial-in facility, where a user may establish a link by calling to the modem, or as a dial-out 
5 facility, where SMC 300E can dial out to a configured number. 

The test shells provide dhect access to alarm and event status information, hi 
addition, the test shells provides the user with access to other information, including 
temperature logs, voltage logs, chassis card fitted table, and the current setting of all the 
configuration parameters. The configuration of SMC 300E may be changed via the test 
10 shells. Any change in configuration is communicated to the relevant cards 300 in system 
100. hi one embodiment, configuration information downloaded via a test shell includes 
a list of the cards 300 expected to be present in system 100, and configuration data for 
these cards 300. The configuration information is stored in flash memory 500, and is 
used every time SMC 300E is powered up. 

15 

rV. SEGREGATION OF LANs 

hi one embodiment, LAN switch 532 physically separates console LAN 
communications from payload communications of the individual host processor cards 
3 OCA. This separation of communications will be described fiirther with reference to 
20 figure 6. 

Figure 6 is an electrical block diagram illustrating a network 600, including server 
systems lOOA and lOOB (collectively referred to as server systems 100) according to one 
embodiment of the present invention. Network 600 includes firewall 602, server systems 
100, LAN switches 608, 610, 618, and 620, software event management server 612, and 
25 hardware event management server 6 1 6. Server system lOOA includes server 

management card (SMC) 300E, hard disk cards 300B, host processor cards 300A-1 and 
300A-2 (collectively referred to as host processor cards 3 00 A), Procurve switch cards 
300C and 300D, and SMC rear transition modules 300F and 300G. As described above, 
SMC 300E is coupled to the management LAN connections of host processor cards 300A 
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via links 53 IB. SMC 300E is also coupled to host processor cards 300A and hard disk 
cards BOOB via I^C buses 554 for retrieving static and dynamic information from the cards 
as described above. 

SMC 300E is connected to SMC rear transition modules 3 OOF and 300G via links 
53 1 A for exchanging management LAN signals over external management network 320. 
hi one embodiment, rear transition modules 300F and 300G include LAN luiks 3 18A and 
318B (collectively referred to as LAN links 318) for connectmg to external management 
network 320 (shown in Figure 3). In one form of the invention, SMC 300E sends out 
console LAN signals via LAN link 3 18A, and simple network management protocol 
(SNMP) hardware events via LAN link 3 1 8B. In one embodiment, LAN link 3 1 8A is not 
used for events. Console LAN signals are exchanged between SMC 300E and host 
processor cards 300A over management LAN Hnks 53 IB. Hardware events are sent by 
host processor cards 300A and hard disk cards 300B to SMC 300E over I^C buses 554 
using internal IPMI commands. 

Host processor cards 300A-1 and 300A-2 are each connected to Procurve LAN 
switches 300C and 300D. SMC 300E controls LAN switches 300C and 300D via 
backplane RS-232 links 31 OB and 3 IOC. LAN switches 300C and 300D include LAN 
links 30 1 A and 301 B (collectively referred to as LAN links 301), respectively, for 
connecting to customer orpayload LANs 303 (shown in Figure 3). hi one embodiment, 
host processor cards 300A send out SNMP software events via LAN link 301 A. In one 
form of the invention, LAN link 30 IB is not used for events. 

As shown in Figure 6, console LAN link 3 1 8 A is physically separated from the 
customer LAN links 301 A and 301B. Additionally, infrastructure events such as failures 
are transmitted over the console LAN link 3 18A through the SNMP protocol, while 
customer events such as a failmg operatmg system (OS) are transmitted on customer 
LAN Imk 301 A. This provides both a logical and physical partitioning of 
communications over the two sets of LAN links 301 and 318. The faults of the 
infrastructure (e.g., hardware fauhs) can be hidden from the owners of the individual host 
processor cards 30A, if desired, and serviced transparently. 
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Hardware events are managed by H/W event management server 616. Hardware 
event management server 616 is connected to LAN link 3 18B via LAN switch 618. 
Software events are managed by software event management server 612. Software event 
management server 612 is coupled to customer LAN link 301 A via LAN switch 610. 
5 Higher-level management software running on software event management server 612, 
such as Openview, Network Node Manager, Tivoli, TopTools, etc., can fault manage a 
server system lOOA through the customer LAN via SNMP traps. The customer LANs 
can be aggregated, and can be monitored by different fault management software leased 
or bought under separate contracts. 

10 In one embodiment, server system lOOB is substantially the same as server system 

100 A. Server system lOOA and server system lOOB are coupled together via LAN 
switches 608, 610, 618, and 620. Switch 608 couples server systems lOOA and lOOB to 
customer LAN Unk 606. Customer LAN link 606 is connected to firewall 602. Switch 
620 couples server systems lOOA and lOOB to console and/or management LAN link 622. 

15 LAN link 622 is connected to firewall 602. Firewall 602 is also coupled to the Internet 
604. Firewall 602 provides security for network 600. 

Hidden line 614 surrounds hardware event management server 616, and LAN 
switches 618 and 620. In one embodiment, hidden line 614 represents a physically secure 
area. 

20 By physically separating the customer LANs 303 and the management LAN 320, 

the potential for outside "snooping" for control information on the customer LANs 303 is 
eliminated, thereby providing a more highly secure infrastructure that can be easily 
maintained. In addition, by partitioning the functionality of the two types of LANs 303 
and 320, support contracts for the chassis provider can be separated from support 

25 contracts for the individual servers in the chassis slots. 

With the integrated LAN switch 532 in SMC 300E for the console LAN signals 
and the pre-routed backplane 106, the customer of the SMC 300E does not have to 
manage a cable bundle for the console LAN signals. With the customer LANs 303 
separate fi-om the console LAN 320, each server "blade" in server system 100 can be an 
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independent system with different payload information that goes outside the system 100 
to a source such as the hitemet 604. With this possibihty of open access to server system 
100, it is very desirable to have the console LAN signals inaccessible to accidental or 
malicious packets. With the console LAN signals physically unconnected to the general 
public, a higher level of security is automatically maintained. 

Although specific embodiments have been illustrated and described herein for 
purposes of description of the preferred embodiment, it will be appreciated by those of 
ordinary skill in the art that a wide variety of alternate and/or equivalent implementations 
may be substituted for the specific embodiments shown and described without departing 
from the scope of the present invention. Those with skill in the chemical, mechanical, 
electro-mechanical, electrical, and computer arts will readily appreciate that the present 
invention may be implemented in a very wide variety of embodiments. This application 
is intended to cover any adaptations or variations of the preferred embodiments discussed 
herein. Therefore, it is manifestly intended that this invention be limited only by the 
claims and the equivalents thereof. 
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